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FINITE-ORDER  IMPLICATIONS  OF  ANY  EQUILIBRIUM 

JONATHAN  WEINSTEIN  AND  MUHAMET  YILDIZ 

Abstract.  Present  economic  theories  make  a  common-knowledge  assrmip- 
tion  that  implies  that  the  first  or  the  second-order  beUefs  determine  all  liigher- 
order  beUefs.  We  analyze  the  role  of  such  closing  assumptions  at  finite  orders 
by  instead  allowing  higher  orders  to  vary  arbitrarily.  Assuming  that  the  space 
of  underlying  uncertainty  is  sufficiently  rich,  we  show  that  the  resulting  set 
of  possible  outcomes,  under  an  arbitrary  fixed  equihbrium,  must  include  all 
outcomes  that  siu-vive  iterated  elimination  of  strategies  that  are  never  a  strict 
best  reply.  For  many  games,  this  imphes  that,  unless  the  game  is  dominance- 
solvable,  every  equihbriimi  will  be  highly  sensitive  to  higher-order  beliefs,  and 
thus  economic  theories  based  on  such  equihbria  may  be  misleading.  More- 
over, every  equihbrium  is  discontinuous  at  each  type  for  which  two  or  more 
actions  survive  our  elimination  process. 
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"Game  theory  ...  is  deficient  to  the  extent  it  assumes  other  fea- 
tures to  be  common  knowledge,  such  as  one  player's  probabihty 
assessment  about  another's  preferences  or  information.  I  foresee 
the  progress  of  game  theory  as  depending  on  successive  reduc- 
tions in  the  base  of  common  Icnowledge  required  to  conduct  use- 
ful analyses  of  practical  problems.  Only  by  repeated  weakening 
of  common  knowledge  assumption  will  the  theory  approximate 
reality"  Wilson  (1987) 

1.  Introduction 

Most  economic  theories  are  based  on  equilibrium  analysis  of  models  that  are 
closed  after  specifying  the  first  and  second-order  behefs,  i.e.,  the  beliefs  about 
underlying  uncertainty  and  the  beliefs  about  other  players'  beliefs  about  un- 
derlying uncertainty.  These  models  assume  that  the  specified  belief  structure  is 
common  knowledge,  i.e.,  conditional  on  the  first  and  the  second-order  beliefs, 
all  of  the  players'  higher-order  beliefs  are  common  knowledge.  Since  these  as- 
sumptions may  easily  fail  in  the  in  the  actual  incomplete-information  situation 
modeled,  these  theories  may  be  misleading  when  the  impact  of  higher-order  be- 
liefs on  equilibrium  behavior  is  large.  There  are  examples  that  suggest  that  this 
impact  might  indeed  be  large  in  some  situations  (see  Rubinstein  (1989),  Fein- 
berg  and  Skrzypacz  (2002),  and  also  Milgrom  and  Weber  (1985)).  To  overcome 
this  fundamental  deficiency,  one  may  want  to  close  the  model  at  higher  orders, 
specifying  more  orders  of  beliefs,  and  hence  weakening  the  common  knowledge 
assumption.  As  Wilson  (1987),  one  might  hope  that  by  specifying  more  and 
more  orders  of  beliefs,  the  theory  would  "approximate  reality."  We  demonstrate 
that  this  is  not  the  case.  We  show  that  regardless  of  how  many  orders  of  beliefs 
are  specified,  the  closing  assumption  is  required  to  gain  any  predictive  power 
beyond  that  of  iterated  elimination  of  strategies  that  are  never  strict  best  reply. 
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Consider  a  situation  where  players  have  incomplete  information  about  some 
payoff-relevant  parameter.  Each  player  has  a  probability  distribution  about 
the  parameter,  which  represents  his  first-order  beliefs,  a  probability  distribu- 
tion about  other  players'  first-order  beliefs,  wloich  represents  his  second-order 
beliefs,  and  so  on.  Imagine  a  researcher  who  has  computed  an  equilibrium  of 
this  game,  where  a  type  of  a  player  is  an  infinite  hierarchy  of  his  beliefs,'  and 
would  like  to  make  a  prediction  about  the  action  of  a  player  i  according  to  this 
equilibrium.  Fix  a  type  U  of  player  i  as  his  actual  type,  and  write  A]  (t,)  for  the 
set  of  all  actions  that  are  played  by  some  alternative  type  of  i  whose  first-order 
beliefs  agree  with  U.  This  set  is  the  set  of  actions  that  the  researcher  cannot  rule 
out  if  he  only  knows  the  first-order  beliefs  and  assumes  that  the  player  plays 
according  to  the  equilibrium.  Similarly,  write  A^  (t^)  for  the  set  of  actions  that 
the  researcher  cannot  rule  out  by  looking  at  the  first  k  orders  of  beliefs.  Write 
A°°  {ti)  for  the  hmit  of  these  (decreasing)  sets  as  k  approaches  infinity,  i.e.,  the 
set  of  all  actions  that  cannot  be  ruled  out  by  the  researcher  by  looking  at  (ar- 
bitrarily many)  finite  orders  of  beliefs.  This  definition  can  be  put  another  way. 
Consider  two  researchers  who  agree  on  the  equilibrium  played.  One  researcher 
is  certain  that  player  i  is  of  type  tj.  The  other  (slightly  suspicious)  researcher 
is  willing  to  agree  with  this  assessment  for  the  first  k  orders  of  beliefs  but  does 
not  have  any  further  assumption.  The  set  A'i  {ti)  is  precisely  the  set  of  actions 
that  will  not  be  ruled  out  by  the  second  researcher. 

In  a  model  that  is  closed  at  order  A-,  all  higher-order  beUefs  are  determined 
by  the  first  k  orders  of  beliefs  and  the  assumption  that  is  made  when  the  model 
is  closed.  We  wish  to  emphasize  the  sensitivity  of  the  model's  predictions  to  the 
closing  assumption.  In  a  given  equilibrium,  the  model  predicts  a  unique  action 
for  each  possible  set  of  beliefs  at  orders  1  through  k,  namely  the  equilibrium 


'For  technical  reasons,  we  assume  that  beliefs  at  each  finite  order  have  coimtable  support. 
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action  for  the  complete  type  implied  by  this  set  of  beliefs  and  the  closing  as- 
sumption. But  in  the  general  model,  every  other  action  in  Af  (t,)  is  played  by 
a  type  whose  first  k  orders  of  beliefs  will  be  exactly  as  this  type  (but  will  fail 
the  closing  assiimption.)  Therefore,  we  cannot  rule  out  any  action  in  A^  [ti] 
without  resorting  to  the  closing  assumption. 

Our  main  result  gives  a  lower  bound  for  Af  (t,).  We  assume  that  the  space 
of  underlying  uncertainty  is  rich  enough  so  that  our  fixed  equilibrium  has  full 
range,  i.e.,  every  action  is  played  by  some  type.  For  countable-action  games, 
we  show  that  A'^  {U)  includes  aU  actions  which  survive  the  first  k  iterations  of 
eliminating  all  actions  which  are  never  a  strict  best  reply  under  tj.  In  particu- 
lar, ^°°  (ij)  includes  all  actions  that  survive  iterated  elimination  of  actions  that 
cannot  be  a  strict  best  reply.  On  the  other  hand,  A^  [ti)  is  a  subset  of  actions 
that  survive  the  first  k  iterations  of  eliminating  strictly  dominated  actions,  and 
hence  A°°  (ij)  is  a  subset  of  rationalizable  actions.  When  there  are  no  ties, 
these  elimination  procedures  lead  to  the  same  outcome,  and  therefore  Af°  (i,) 
is  precisely  equal  to  the  set  of  rationalizable  outcomes.  We  extend  this  charac- 
terization to  nice  games,  where  the  action  spaces  are  one-dimensional  compact 
intervals  and  the  the  utility  functions  are  strictly  concave  in  own  action  and 
continuous — as  in  many  classical  economic  models. 

To  illustrate  the  main  argument  in  the  proof  of  the  lower  bound,  we  now 
explain  why  A]  (tj)  includes  all  actions  that  survive  the  first  round  of  elimination 
process.  Let  ii  vary  over  the  set  of  types  that  agree  with  ti  at  first  order  (i.e., 
concerning  the  underlying  parameter)  but  may  have  any  beliefs  at  higher  orders 
(i.e.,  concerning  the  other  players'  type  profile.)  Our  full  range  assumption 
implies  that  there  are  types  i^  with  any  beliefs  whatsoever  about  other  players' 
equilibrium  action  profile.  Given  any  action  a^  of  i  that  is  a  strict  best  reply 
to  his  fixed  belief  about  the  parameter  and  some  belief  about  the  other  players' 
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actions,  there  is  a  type  U  who  has  these  behefs  in  equihbrium,  and  therefore  must 
play  the  strict  best  reply,  a^,  in  equilibrium.  This  argument  will  be  formalized 
as  part  of  an  inductive  proof  of  the  main  result. 

For  general  games,  Nash  equilibrium  has  weak  epistemic  foundations  (Au- 
mann  and  Brandenburger  (1995))  in  comparison  to  iterative  admissibihty  (Bran- 
denburger  and  Keisler  (2002))  and  rationahzability  (Bernheim  (1985),  Pearce 
(1985)).  Yet,  in  application,  researchers  frequently  use  equilibrimxi  analysis  and 
further  focus  on  a  particular  equilibrium,  invoking  refinement  arguments  and 
such,  so  that  they  can  make  predictions.  Our  result  shows  that  the  predictive 
power — beyond  that  of  om'  elimination  process — obtained  in  this  way  comes 
from  the  assumption  that  is  (implicitly)  made  when  the  model  is  closed.  That 
is,  for  any  such  prediction,  there  are  types  that  are  ruled  out  by  the  closing 
assumption  and  that  behave  inconsistently  with  the  prediction  in  the  focused 
equilibrimn.  Therefore,  our  result  suggests  that  the  closing  assumption  deserves 
a  close  scrutiny,  and  needs  to  be  justified  at  least  as  much  as  the  explicit  as- 
sumptions of  the  model.  It  would  be  highly  desirable  to  investigate  whether  the 
types  that  behave  inconsistently  with  the  prediction  of  the  closed  model  can  be 
excluded  by  a  weaker  set  of  assumptions. 

From  an  evolutionary  point  of  view,  when  there  are  privately  observed  sig- 
nals, if  a  myopic  adjustment  process  converges,  its  limit  is  a  Nash  equilibrium  of 
the  incomplete-information  game  with  these  signals  as  private  information.  Our 
result  suggests  then  that  the  limit  behavior  of  such  a  process  may  depend  on  the 
elusive  signals  about  the  distribution  of  other  players'  signals,  higher-order  sig- 
nals about  these  signals,  and  so  on.  Incidentally,  our  result  has  counterparts  in 
sophisticated  and  Bayesian  learning  models:  the  learning  of  sophisticated  agents 
leads  to  equilibrium  if  and  only  if  the  game  is  dominance  solvable  (Milgrom  and 


6  JONATHAN  WEINSTEIN  AND  MUHAMET  YILDIZ 

Roberts  (1991)),  and  in  a  specific  model,  any  sequence  of  rationalizable  action 
profiles  can  be  a  sample  path  in  Bayesian  learning  (Nyarko  (1996)). 

Our  result  also  points  to  a  close  link  between  higher-order  reasoning  and 
the  equilibrium  impact  of  higher-order  uncertainty.  When  there  axe  no  ties, 
assrmiing  /cth-order  mutual  knowledge  of  payoffs  and  that  a  fixed  equilibrium 
(with  full  range)  is  played  is  equivalent  to  assuming  /cth-order  mutual  knowledge 
of  rationality  and  common  knowledge  of  payoffs."  This  implies  that  when  the 
equihbrium  impact  of  high-order  uncertainty  is  large,  the  impact  of  high-order 
failvires  of  rationality  is  also  large.  In  that  case,  predictions  may  be  unreliable 
without  a  very  accurate  knowledge  of  players'  reasoning  capacity. 

It  is  well  known  that  some  Nash  equilibria  may  be  discontinuous  in  product 
topology  and  with  respect  to  higher-order  uncertainty,  as  in  the  electronic-mail 
game  of  Rubinstein  (1989).  There  is  an  interest  in  rmderstanding  how  severe  this 
discontinuity  is.  Monderer  and  Samet  (1989,1997)  and  Kajii  and  Morris  (1998) 
have  analyzed  the  weakest  topologies  that  make  the  equilibrium  continuous 
over  all  games  (see  also  Milgrom  and  Weber  (1985)  for  a  continuity  result.) 
These  topologies  are  cjuite  strong,  but  since  they  focus  on  the  worst  case  games, 
such  as  the  electronic-mail  game,  it  is  not  clear  whether  the  equilibria  used 
in  appUcations  will  be  highly  sensitive  to  higher-order  uncertainty.  Our  result 
implies  (and  we  formally  establish)  that,  if  the  space  of  underlying  uncertainty 
is  sufficiently  rich,  every  equilibrium  is  discontinuous  (with  respect  to  product 
topology  and  higher-order  beliefs)  for  every  game  at  every  type  for  which  two 
or  more  actions  survive  our  elimination  process. 


The  relationsliip  between  assumptions  about  rationality  and  payofF  uncertainty  is  not 
straightforward;  A'^  may  differ  from  both  rationaUzabihty  and  iterative  admissibility. 
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As  a  precedent  to  our  main  result,  Brandenburger  and  Dekel  (1987)  show  that 
every  rationaUzable  outcome  is  the  outcome  of  a  subjective  correlated  equihb- 
rium  (see  Section  3  for  a  discussion.)  Battigalli  and  Siniscalchi  (2003)  extended 
this  result  to  djmamic  games  and  investigated  the  imphcations  of  the  restrictions 
on  first-order  beliefs  and  common  strong  belief  in  sequential  rationality  on  the 
rationahzable  outcomes,  which  coincide  with  all  equilibrium  outcomes.  It  seems 
that,  using  their  methodology,  one  can  obtain  sharp  predictions  in  sequential 
games  using  relatively  mild  assumptions.  Note  that  in  sequential  games,  our 
lower  bound  is  usually  weak,  and  assumptions  about  sequential  rationality  yield 
strong  predictions  (Battigalh  and  Siniscalchi  (2002)  and  Feinberg  (2002)). 

Our  next  section  contains  the  basic  definitions  and  prehminary  results.  Sec- 
tion 3  is  the  heart  of  the  paper.  There  we  develop  our  main  notions  and  prove 
our  main  theorem.  Our  main  theorem  is  extended  to  the  nice  games  as  a  charac- 
terization in  Section  4,  and  to  mixed  strategies  and  to  the  spaces  of  uncertainty 
that  are  not  necessarily  rich  in  Section  5.  In  Section  6,  we  present  our  discon- 
tinuity results  and  discuss  their  methodological  implications  for  global  games 
and  robustness  of  equihbria.  Section  7  contains  a  very  negative  result  about 
Com'not  oligopoly  as  an  application.  Section  8  concludes.  Some  of  the  proofs 
are  relegated  to  the  appendix. 


2.  Basic  Definitions  and  Preliminary  Results 

Notation  1.  Given  any  list  Yi, . . . ,  y„  of  sets,  write  Y  =  fJi  ^i>  ^-z  =  Yljjti  ^j^ 

y-i  =  (yi,...,yi-i,yi+i,...,2/„)  e  YL,,  and  (yj,y_0  =  {yi, . . .  ,yi^l,y^,y^+l, . . .  ,yn)- 
Likewise,  for  any  family  of  functions  fj  :  Y]  -^  Zj,  we  define  /_i  :  Y^i  — *  Z^i 
by  /_,  (y_,)  =  (/j  {yj))j^,-    Given  any  metric  space  {Y,d),  we  write  A{Y)  for 
the  space  of  probability  distributions  on  Y,  suppressing  the  fixed  cr-algebra  on 
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Y  which  at  least  contains  all  open  sets  and  singletons;  we  use  the  product 
(j-algebra  in  product  spaces.  The  support  of  it  is  denoted  by  suppTr. 

We  consider  a  game  with  finite  set  of  players  A''  =  {1,  2, . . . ,  n}.  The  source 
of  underlying  uncertainty  is  a  payoff-relevant  parameter  6  E  Q  where  (0,  d)  is  a 
compact,  complete  and  separable  metric  space,  with  d  a  metric  on  set  0.  Each 
player  i  has  action  space  Ai  and  utility  function  w,  :  0  x  ^  ^  E,  where  A  = 
Yli  Ai.  We  endow  the  game  with  the  universal  type  space  of  Brandenburger  and 
Dekel  (1993),  a  variant  of  an  earlier  construction  by  Mertens  and  Zamir  (1985), 
with  an  additional  assumption  that  the  players'  beliefs  at  each  finite  order  have 
comitable  (or  finite)  support. "^  Types  are  defined  using  the  auxiliary  sequence 


A(X,_0 


X  Xfc_i 


{Xk}  of  sets  defined  inductively  hy  Xq  =  Q  and  Xk  = 
for  each  k  >  0,  where  A  (-^fc-i)  is  the  set  of  probability  distributions  on  Xk-i 
that  have  coimtable  (or  finite)  support.  We  endow  each  Xk  with  the  weak 
topology  and  the  cr-algebra  generated  by  this  topology.  A  player  z's  first  order 
beliefs  (about  the  underlying  uncertainty  6)  are  represented  by  a  probabihty 
distribution  t]  on  A'o,  second  order  beliefs  (about  all  players'  first  order  beliefs 
and  the  underlying  uncertainty)  are  represented  by  a  probability  distribution  f f 
onXi,  etc.  Therefore,  a  type  t^  of  a  player  i  is  a  member  of  f^^j  A  (Xk-i)-  Since 
a  player's  /cth-order  beliefs  contain  information  about  his  lower-order  beliefs,  we 
need  the  usual  coherence  requirements.  We  write  T  =  YiieN  -^*  ^^^  ^^^  subset 
of  (  YikLi  ^  (Xk-i) )  in  which  it  is  common  knowledge  that  the  players'  beliefs 
are  coherent,  i.e.,  the  players  know  their  own  beliefs  and  their  marginals  from 
different  orders  agree.  We  will  use  the  variables  t,,tj  G  Ti  as  generic  types  of 
any  player  i  and  t,i  €  T  as  generic  type  profiles.  For  every  U  e  Ti,  there  exists 


This  assumption  is  made  to  avoid  technical  issues  related  to  measurability  (see  Remark 
1.)  Our  type  space  is  dense  in  universal  type  space,  and  any  countable  type  space  with  no 
redundant  type  is  embedded  in  our  space. 
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a  probability  distribution  Kt^  on  0  x  T_i  such  that 

(2.1)  tf  =  5j.-i  xmarg0^[^(_Y,_2)]'^\«'^«.'         (^^') 

and  t}  =  margQ/vt^,  where  S^k-l  is  the  probabihty  measure  that  puts  probabihty 
1  on  the  set  {tf~^}  and  marg  denotes  the  marginal  distribution.  Conversely, 
given  any  distribution  Kt^  on  0  x  T_j,  we  can  define  t^  G  T,  via  (2.1),  as  long  as 
margg^r^jY  _  )]'^\{>}«^ti  is  always  coimtable. 

A  strategy  of  a  player  i  is  any  measirrable  function  st  :  T^  —^  At.  Given  any 
type  ti  and  any  profile  s_i  of  strategies,  we  write  7r{-\ti,s_i)  G  A  (0  x  A^i) 
for  the  joint  distribution  of  the  underlying  uncertainty  and  the  other  players' 
actions  induced  by  ti  and  s_i;  vr  (-ItijCr^,)  is  similarly  defined  for  correlated 
mixed  strategy  profile  cr_i.  For  each  i  E  N  and  for  each  belief  vr  e  A  (0  x  A^i), 
we  write  BRi  (tt)  for  the  set  of  actions  Oj  G  Ai  that  maximize  the  expected 
value  of  Ui  {9,ai,a-i)  under  the  probabihty  distribution  tt.  A  strategy  profile 
s*  =  {sl,S2,  ■  ■ .)  is  a  Bayesian  Nash  equilibrium  iff  at  each  ti, 

s*{t,)eBR,{-K{-\t,,s*_,)). 

An  equilibrium  s*  is  said  to  have  full  range  iff 

(FR)  s*{T)^A. 

The  following  assumption  implies  that  every  equilibrimxi  s*  has  full  range. 

Assumption  1  (Richness  of  0).  Given  any  i  E  N ,  any  /x  G  A  [A^i),  and  any 
ai,  there  exists  a  probability  distribution  u  on  0  with  countable  support  and  such 
that 

BR,  [u  x  i^l)  =  {aj  . 

Lemma  1.   Under  Assumption  1,  every  equilibrium  s*  has  full  range. 

Proof.  The  proofs  that  are  omitted  in  the  text  are  in  the  appendix.  D 
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Elimination  Processes.  We  will  use  interim  notions  and  allow  correlations  not 
only  witMn  players'  strategies  but  also  between  their  strategies  and  the  under- 
lying uncertainty  0.  Such  correlated  rationalizability  is  introduced  by  Battigalli 
and  Siniscalchi  (2003)  and  Dekel,  Fudenberg,  and  Morris  (2003).  Clearly,  al- 
lowing such  correlation  only  makes  our  sets  larger.  Since  our  main  result  is  a 
lower  bound  in  terms  of  these  sets,  this  only  strengthens  our  result.  Moreover, 
our  characterization  provides  yet  another  justification  for  this  correlated  ratio- 
nalizability. Write  Mi  for  the  set  of  all  measurable  functions  from  0  x  T^  to  A^. 
Towards  defining  rationahzability,  define  sets  S^  [ti\,  i  &  N,  U  E  Ti,  /.-;  =  0, 1, . .  ., 
iteratively  as  follows.  Set  5°  [U]  =  Ai.  For  each  k  >  0,  let  5*^7^  C  M_j  be  the 
set  of  all  measurable  functions  /  :  6  x  T_i  -^  A^^  such  that  /  (6*,  t_,)  G  S*^"^  [t_j] 
for  each  t_i.  Let  also  S'i"^  be  the  set  of  all  probability  distributions  on  5^7^- 
Note  that  E^7^  i^  the  set  of  all  possible  beliefs  of  player  i  on  other  players' 
allowable  actions  that  are  not  eliminated  in  the  first  k  —  \  rounds.  Write 

S\{t^=      U      BR,{'K{\U,a^,)) 

for  the  set  of  all  all  actions  a^  of  i  that  are  best  reply  against  some  of  his  beliefs 
in  E^"-^.  The  set  of  all  rationalizable  actions  for  player  i  (with  type  U)  is 

CX3 

sr  [u]  =  n  ^'  [^^]  • 

fc=0 

Next  we  define  the  set  of  strategies  that  survive  iterative  elimination  of  strate- 
gies that  are  never  strict  best  reply,  denoted  by  W°°  [U] ,  similarly.  We  set 
Wf  [U]  =  A,  and 

Wl"  [U]  =  [a,\BR,  (7r(-|i„a_,))  =  {a,}  for  some  a_,  e  A  (h/-^7')}  > 
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where  W^^^  C  M_i  is  the  set  of  all  functions  /  :  0  x  TL^  -^  A-i  such  that 
f{6,t^i)  6  W^''^  [t_j]  for  each  t-^.  Finally,  we  set 

oo 
fc=0 

Notice  that  we  eliminate  a  strategy  if  it  is  not  a  strict  best-response  to  any 
belief  on  the  remaining  strategies  of  the  other  players.  Clearly,  this  yields  a 
smaller  set  than  the  result  of  iterative  admissibility  (i.e.,  iterative  elimination 
of  weakly  dominated  strategies)."*  In  some  games,  iterative  admissibility  may 
yield  strong  predictions.  For  example,  in  finite  perfect  information  games  it 
leads  to  backwards  induction  outcomes.  Nevertheless,  in  generic  normal-form 
games  (as  defined  in  Definition  1  below),  all  these  concepts  are  equivalent  and 
usually  have  weak  predictive  power. 

3.  Equilibrium  predictions  with  finite-order  beliefs 

We  are  interested  in  how  robust  equihbrium  is  against  the  failure  of  assump- 
tions made  at  high  orders,  such  as  the  failure  of  the  common  knowledge  as- 
sumption at  high  orders.  We  now  formalize  our  notion  of  robustness. 

Let  us  fix  an  equilibrium  s*  and  a  type  t^  of  a  player  i.  According  to  equi- 
librium, he  will  play  s*  (U).  Now  imagine  a  researcher  who  only  knows  the  first 
fcth-order  beliefs  of  player  i  and  knows  that  equilibrium  5*  is  played.  All  the  re- 
searcher can  conclude  from  this  information  is  that  i  will  play  one  of  the  actions 
in 


In  particular,  if  we  use  non-reduced  normal-form  of  an  extensive-form  game,  many  strate- 
gies will  be  outcome  equivalent,  in  which  case  our  procedure  will  eliminate  all  of  these  strate- 
gies. To  avoid  such  over-elimination,  we  can  use  reduced-form,  by  representing  all  outcome- 
equivalent  strategies  by  only  one  strategy. 
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Assuming,  plausibly,  that  a  researcher  can  verify  only  finitely  many  orders  of  a 
player's  beliefs,  all  a  researcher  can  ever  know  is  that  player  i  will  play  one  of 
the  actions  in 


Ar[s\U]  =  f]Al[s\U]. 


k=0 

We  are  now  ready  to  prove  our  main  result  for  countable-action  games,  i.e., 
games  where  each  player  i  has  a  countable  or  finite  action  space  A^. 

Proposition  1.  For  any  countable- action  game,  any  equilibrium  s*  with  full 
range,  any  k  E  N,  i  £  N,  and  any  ti, 


in  particular. 


wnu]^Ai\s\t,]csnu]: 


wr[t^]^AT[s\t,\csm 


Proof.  The  inclusion  A\  [s*,tj]  C  Sf  [ti]  is  established  by  Proposition  8  in  the 
Appendix  for  general  games  and  all  equilibria.  We  will  now  show  that  W^  \ti\  C 
Af  [s*,ti].  For  fc  =  0,  the  statement  is  given  by  the  full-range  assumption. 
For  any  given  k  and  any  player  i,  write  each  t_i  as  t_t  =  (/,  h)  where  /  = 
(tij,  t?_j, . . . ,  t^""^)  ^'^d  h  =  (t^j,  t^|\  . . .)  are  the  lower  and  higher-order  beliefs, 
respectively.  Let  L  =  {/|3/i  :  (/,  h)  €  TL,}.  The  induction  hypothesis  is  that 

W':-'  [I]  ^  U  Wt-'  [{I  h!)]  C  At-'  [s\  [I  h)]     (V  [l  h)  e  T_,). 

h' 

Fix  any  type  ti  and  any  a^  G  Wj^  [ti].  We  will  construct  a  type  ii  such  that 
s*  (ti)  =  ai  and  the  first  k  orders  of  beliefs  are  same  under  ti  and  ti,  showing  that 
Qi  e  A'i  [s*,ti].  Now,  by  definition,  for  some  a^i  G  A{W'll'),  a,  is  the  unique 
best  reply  for  type  ti  if  ti  assigns  probability  distribution  (T_j  on  the  other  play- 
ers' strategies,  i.e.,  BRi  (tt  (-l^i,  a^^))  =  {a,}.  Let  P  {-[ti,  a_^)  be  the  probability 
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distribution  on  0  x  L  x  A^t  induced  by  Kt^  and  a^t.  By  the  induction  hypoth- 
esis, for  each  (^, /,  a_0  G  suppP  (-It,,  a_,),  a_,  G  W^'^  [I]  C  At',^  [s\  (IJi)]  for 
some  h.  Hence,  there  exists  a  mapping  n  :  suppP  {-{ti,  a^i)  -^  Q  x  T^i, 

(3.1)  /i:(^,/,a_,)^  (^,/,Ma_„^,/)), 
such  that 

(3.2)  sU(l,h{a^i,e,l)^=a_i. 


We  define  U  by 


i^U  =  ^(•|^t,o--j)  O/i   \ 


the  probabihty  distribution  induced  on  0  x  T_j  by  the  mapping  ji  and  the 
probabihty  distribution  P  (-It,,  o^i).  Notice  that,  since  t'l  has  countable  support 
and  the  action  spaces  are  countable,  the  set  suppP  (•|tj,(T_j)  is  comitable,  in 
which  case  /i  is  trivially  measurable.  Hence  Kj^  is  well-defined.  By  construction 
of  /.i,  the  first  k  orders  of  beliefs  (about  (6',  /))  are  identical  mider  U  and  U: 

marge^^/vj-^  =  msigQ^^P  {-{U^a^i)  o  n'^  =  margQ^^P  {■\U,a_^)  =  margg^L/^ti, 

where  the  second  inequality  is  by  (3.1)  and  the  last  equality  is  by  definition  of 
P  (-[ti,  cr_t).  Moreover,  using  the  mapping  7  :  {6,  /,  h)  \-^  [6,  /,  s*_^  (/,  /?)) ,  we  can 
check  that  the  distribution  induced  by  ki^  and  s*_^  on  0  x  L  x  A_i  is 

P  (-1^,,  s\)  =  Ki^  o  7-1  =  P  (.|t„  a_,)  o  ^r^  o  7-1  =  P  {.\U,  a..,)  , 

where  the  last  equality  is  due  to  the  fact  that  /i  is  the  inverse  of  the  restriction 
of  7  to  suppK;j-^ .  Therefore, 


TT 


{■\ii,  s%)  =  margexL^  {'lU,  s%)  =  marge^^P  (-1^^,  c7_,)  =  it  {-lU,  a-i) 


That  is,  the  equilibrium  beliefs  of  U  about  0  x  A^t  are  identical  to  the  beliefs 
of  ti  about  0  x  A_i  when  U  assigns  probability  distribution  (T_j  on  the  other 
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players'  strategies.  Since  o^  is  the  only  best  reply  to  these  beliefs,  ii  must  play 
ai  in  equilibrium: 

(3.3)  s*  {U)  e  BR,  {n  {■]{,,  s^))  =  BR,  {n  {-lU,  a_,))  =  (aj  . 


D 


Remark  1.  Notice  that  the  countability  assumptions  about  the  finite-order 
beliefs  and  the  action  spaces  are  used  only  to  make  sure  that  kj  is  a  well- 
defined  probability  distribution,  or  /i  is  measurable.  In  fact,  whenever  jj,  is 
measurable,  our  proof  is  valid.  In  the  next  section,  we  present  another  class  of 
games  in  which  /,i  is  measurable;  /i  may  not  be  measurable  in  general. 

The  conclusion  that  VV^  [tt]  C  A^  [s*  ,ti\  can  be  spelled  out  as  follows.  Suppose 
that  we  know  a  player's  beliefs  up  to  the  fcth  order  and  do  not  have  any  further 
information.  Suppose  also  that  he  has  an  action  a,  that  survives  k  rounds  of 
iterated  elimination  of  strategies  that  cannot  be  a  strict  best  reply — for  some 
type  whose  first  k  orders  of  behefs  are  as  specified.  Then,  we  cannot  rule  out 
that  aj  will  be  played  in  equilibrium  s*.  Put  it  differently,  if  we  have  a  model 
that  is  closed  at  order  k  and  if  an  action  survives  k  rounds  of  iterated  elimination 
of  strategies  that  cannot  be  a  best  reply  for  a  type  within  the  model,  then  we 
cannot  rule  out  action  a^  as  an  equilibrium  action  for  that  type  without  invoking 
the  closing  assumption.  Hence,  any  prediction  that  does  not  follow  from  the 
first  k  steps  of  this  ehmination  process  comes  from  the  closing  assumptions, 
rather  than  the  assumptions  that  lead  to  a  specific  equilibriimi  s*.  This  suggests 
that,  contrary  to  the  current  practice  in  economics,  a  researcher  needs  to  justify 
his  closing  assimiption  at  least  as  much  as  the  other  assumptions,  such  as  the 
rationale  for  equilibrium  selection. 
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The  part  Af  [s*,ti]  C  S^  [ti]  is  proved  in  the  Appendix  for  general  games  and 
for  all  equilibria  (see  Proposition  8).  Although  the  proof  for  the  general  case  is 
somewhat  involved,  it  is  straightforward  for  the  complete-information  case. 

Notation  2.  For  any  9  E  Q,  write  tP^  (O)  for  the  type  of  a  player  i  who  is 
certain  that  it  is  common  knowledge  that  9  =  9. 

For  the  types  of  the  form  tf^  (9),  the  proof  is  as  follows.  Notice  that 
A'^  [s*,tf^  [9)]  C  Si  [tf^^  [9]]  means  that,  if  a  player  i  has  fcth-order  knowl- 
edge of  6'  =  ^,  then  his  equilibrium  action  (according  to  s*)  will  survive  kth 
round  of  iterated  elimination  of  strictly  dominated  strategies  under  the  restric- 
tion that  0  =  {9].  Towards  an  induction,  assume  that  Aj"^  [s*,tf^'^  [9)]  C 
Sj  [tf''^  (9)]  for  each  j.  That  is,  if  a  player  j  has  k  —  Ist-order  knowledge  of 
9  =  9,  j  will  play  an  action  in  Sj~^  (under  9  =  {9}.)  But  any  type  of  player 
i  who  has  A;th-order  knowledge  of  ^  =  ^  is  certain  that  every  other  player  j 
has  k  —  Ist-order  knowledge  of  9  =  9.  Hence,  in  equilibrium,  he  is  certain  that 
j  plays  an  action  in  S^~^.  Since  his  equilibrium  action  is  a  best  response  to 
such  a  belief  (with  support  contained  in  S'iJ^),  it  must  survive  the  A;th  round 
of  elimination. 

Brandenburger  and  Dekel  (1987)  show  that,  given  any  rationalizable  outcome 
of  a  game,  by  adding  payoff  irrelevant  types,  we  can  construct  a  type  space 
with  an  equilibrium  that  yields  the  original  rationalizable  outcome.'^  Since  we 
need  to  choose  a  different  equilibrium  for  each  rationahzable  outcome,  there 
is  a  large  multiplicity  of  equilibria,  and  thus  equilibrium  as  a  solution  concept 
does  not  have  more  predictive  power  than  rationalizability  has.  One  may  want 
to  ignore  this  multiplicity  by  focusing  on  a  particular  equilibrium  or  relying 
on  one  of  the  many  refinements  developed  in  the  last  few  decades — in  order 


""See  Bergemann  and  Morris  (2003)  for  an  important  application  of  tliis  adea. 
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to  cope  with  the  usual  multiphcity  problem.  Our  result  shows  that,  once  we 
abandon  artificial  restrictions  on  type  space,  this  unpredictability  reappears  as 
high  variability  of  any  fixed  equilibrium  with  respect  to  very  high-order  beliefs, 
albeit  with  somewhat  smaller  scope  due  to  the  stronger  elimination  process. 
There  is  an  intuitive  relation  between  these  two  results.  Since  type  spaces  in 
general  can  be  embedded  in  the  universal  type  space,  given  any  fixed  set  of 
beliefs  at  finite  orders  and  a  fixed  equilibrium  behavior  in  a  fixed  type  space, 
we  can  envision  a  coherent  type  whose  lower-order  beliefs  are  as  the  former 
but  whose  higher-order  beliefs  assigns  high  probability  to  the  latter.  That  type 
will  give  a  best  reply  to  the  equilibrium  in  the  latter.  Hence,  multiplicity  of 
equilibria  in  various  type  spaces  tends  to  yield  high  variability  of  equilibria 
with  respect  to  the  higher-order  beliefs  in  universal  type  space.  This  intuition, 
however,  does  not  yield  a  proof.  This  is  because  the  distinctions  among  the 
types  in  Brandenburger  and  Dekel  are  all  payoff  irrelevant,  and  thus  their  type 
spaces  are  not  contained  in  the  universal  type  space.  More  importantly,  the 
equilibrium  behavior  in  various  type  spaces  need  not  be  different  witliin  a  fixed 
equilibrium.  In  fact,  Brandenburger  and  Dekel  use  a  single  type  space  in  their 
proof;  hence,  if  their  type  space  were  contained  in  the  universal  type  space,  the 
equilibrium  behavior  in  this  type  space  would  be  uniquely  determined  by  the 
equilibrium  in  the  universal  type  space. 

Om:  next  example  shows  that  either  of  the  inclusions  in  Proposition  1  may 
be  strict.  Hence,  (i)  some  rationalizable  strategies  may  not  be  in  A°°,  showing 
the  distinction  between  the  results  of  Brandenburger  and  Dekel  and  ours,  and 
(ii)  A°°  may  include  some  weakly  dominated  strategies,  distinguishing  our  result 
from  the  characterization  of  Brandenburger  and  Keisler  (2000). 
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Example  1.  Take  A''  =  {1,2},  6  =  {^o,^i},  and  let  the  action  spaces  and  the 
payoff  functions  for  each  6  be  given  by 


aO      a' 


a 


a 


(Note  that  9  is  not  payoff  relevant.)  Define  s*  by 


0,0 

0,0 

0,0 

1,1 

s*  iU)  = 


a}    otherwise. 


Clearly,  for  each  A:  >  1,  we  have  W^*^  [U]  =  {a^}  and  S^  [ti\  =  {cP,a^}  for  each 
U,  while  4^  [s*-tf^  {9o)]  =  {a^,a'},  and  Af  [s*;f  ^  (^i)]  =  {a'}. 

Proposition  1  yields  a  characterization  whenever  the  payoffs  are  generic  in 
the  following  (standard)  sense. 

Definition  1.  We  say  that  the  payoffs  are  generic  at  9  iff  there  do  not  exist  i, 
non-zero  a  G  R^\  and  distinct  a,,  a[,  a^i,  and  a'_j  such  that  (i)  u^  {9,a^,a^i)  — 
u,  {9,  a[,  a_j)  or  (ii)  Y.a,  ^  (^0  u^  {9,  ai,  a_,)  =  Y.a,  "  ('^0  ^^  (^'  ^''  ^-r)  =  0. 


Wlien  the  payoffs  are  generic  at  9  and  it  is  common  knowledge  that  9  =  9, 
then  any  action  that  is  not  strictly  dominated  will  be  a  strict  best  reply  against 
some  belief  (at  each  round),  and  hence  the  two  elimination  processes  will  be 
equivalent.  In  that  case,  Proposition  1  yields  the  following  characterization. 

Corollary  1.  For  any  finite-action  game  and  any  equilibrium  s*  with  full  range, 
if  the  payoffs  are  generic  at  some  9,  then  for  each  i  and  k, 


A^[s\ti 


\k  r„*    fCK 


5f  [tr  {0)]  . 
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That  is,  in  generic  finite-action  games,  a  researcher's  predictions  based  on 
finite  orders  of  players'  beUefs  and  equihbrium  will  be  equivalent  to  the  predic- 
tions that  follow  from  rationalizabihty.  This  characterization  will  be  generalized 
to  the  following  widely-used  class  of  games. 


4.  Nice  games 

We  will  now  consider  a  class  of  "nice"  games  (Mouhn  (1984)),  which  are 
widely  used  in  economic  theory,  such  as  imperfect  competition,  spatial  compe- 
tition, provision  of  public  goods,  theory  of  the  firm,  etc.  We  will  show  that 
Af  [s*,ti]  =  S^  [U]  for  each  k  whenever  equihbrium  s*  has  full  range. 

Definition  2.  A  game  is  said  to  be  nice  iff  for  each  i,  A^  =  [0, 1]  and  u^  {9,  ai,a_i) 
is  continuous  in  a  =  (oj,  a_j)  and  strictly  concave  in  a^. 

We  use  the  strict  concavity  assumption  to  make  sure  that  a  player's  utility 
function  for  any  fixed  strategy  profile  of  the  others  is  always  single-peaked  in 
his  own  action.  (Single-peakedness  is  not  preserved  in  presence  of  uncertainty.) 
We  use  the  continuity  assumption  to  make  siire  that  a  player's  strategy  best 
response  is  continuous  with  respect  to  the  other  players'  strategies.  For  the 
complete  information  types,  our  results  in  this  section  will  be  true  under  the 
weaker  condition  that  Uj(^,-,a_j)  is  single-peaked  with  a  maximand  that  is 
continuous  in  a_,.  Now,  since  our  players  have  always  unique  best  reply,  our 
ehmination  processes  will  be  equivalent,  yielding  the  functional  equation 


(4.1)  W  =  S. 
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Moreover,  our  next  lemma  ensm'es  that,  despite  our  uncountable  action  spaces, 
we  only  need  to  consider  coimtably  many  actions  for  types  with  countable  sup- 
ports, allowing  us  to  circumvent  the  measurability  issue  discussed  in  Remark 
1. 

Lemma  2.  For  any  nice  game,  for  any  i,  U,  k,  and  any  a,  G  S^  [ti\,  there  exists 
S-t  E  5^7^  such  that 

BR,{TT{-\t,,s_,))  =  {a,}. 

Together  with  (4.1),  Lemma  2  gives  us  our  main  result  for  this  section. 

Proposition  2.  For  any  nice  game,  let  s*  be  any  equilibrium  with  full  range. 
Let  also  Q  x  T  be  a  countable  subset  of  Q  x  T  such  that  for  each  ti  €  %, 
suppni  C  0  X  T-i.   Then,  for  any  k  eN,  i  E  N,  and  ti  G  Ti, 

in  particular, 

sr  [u]  =  Ar  [s\u] . 

Proof  For  any  a^  G  5f  [u]  =  Wj"  [u] ,  by  Lemma  2,  there  exists  s_i  G  S*^"^  = 
W_~^  such  that  o^  is  a  strict  best  reply  against  tt  {-{ti,  s_j).  Since  «£  has  comit- 
able  support,  P(-|ti,s_i),  the  probability  distribution  induced  by  k^^  and  s-i 
on  G  X  L  X  A^i,  has  a  countable  support: 

suppP  (-Iti,  5_,)  =  {{6, 1,  s_^  [6, 1,  h))  I  [6, 1,  h)  G  suppACj,}  . 

Hence  our  proof  of  Proposition  1  applies.  That  is,  there  exists  U  G  Ti  (not 
necessarily  in  Tj)  such  that  5*  [u]  =  Qi  and  t-"  =  tf*  for  each  m  <  k.  D 
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5.  Extensions 

For  ease  of  exposition,  we  have  so  far  focused  on  pure  strategy  equilibria 
with  fuU  range.  In  this  section,  we  will  extend  oiir  results  for  mixed  strategy 
equilibria  and  beyond  the  full-range  assumption. 

5.1.  Mixed  Strategies.  Since  all  equilibria  in  nice  games  are  in  pm^e  strate- 
gies, we  will  focus  on  the  comitable-action  games.  Using  interim  formulation, 
we  define  a  mixed  strategy  as  any  measurable  function  ai  :  Ti  -^  A(y4j). 
A  mixed  strategy  profile  a*  is  Bayesian  Nash  equilibrium  iff  supper*  (tt)  C 
BRi  (tt  [■\ti,a*_^))  for  each  i  and  ti.  Writing  T^'  =■  {ti\  Isuppcr*  (ij)|  =  1}  for 
the  set  of  types  who  play  pure  strategies,  we  define  a  mapping  sf  *  :  Tf  —^  Ai 
by  supper*  (tj)  =  {sf  {t^)}.  We  then  use  this  "pure  part  of"  a*  to  extend  our 
previous  definitions  and  results  to  mixed  strategies.  We  say  that  a*  has  full 
range  iff  s'^*  {T"' )  =  A  and  set 

the  set  of  all  actions  that  are  played  with  probability  1  under  a*  by  some  type 
ii  whose  first  k  orders  of  beliefs  are  identical  to  those  of  t^.  Clearly,  every 
equihbrium  has  full  range  under  Assumption  1,  i.e.,  when  0  is  sufficiently  rich. 

Proposition  3.  For  any  countable- action  game,  any  (possibly  mixed  strategy) 
equilibrium  a*  with  full  range,  any  k  <  co,  i  G  N,  and  any  ti, 

Wt[t.]CAl[a\t,]CSf[t,]. 

Proof.  In  the  proof  of  Proposition  1,  insert  s'^'  everywhere  s*  appears,  and 
restrict  the  range  of  /i  and  the  domain  of  7  to  0  x  Tf*.  Notice  that,  by  (3.3), 

uerr'.  □ 
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That  is,  if  a*  has  full  range  (e.g.,  if  0  is  sufficiently  rich)  and  we  know  only  the 
first  k  orders  of  a  player's  behefs,  then  for  any  a^  G  W^  [U],  we  cannot  rule  out 
that  ttj  is  played  with  probability  1  according  to  a* .  For  A;  >  1,  the  full-range 
assumption  can  replaced  by  the  weaker  assumption  that  A^  C  U;^  supper*  (tj). 

5.2.  Without  full  range.  Our  full  range  assumption  allowed  us  to  consider 
large  changes.  A  researcher  may  be  certain  that  it  is  common  knowledge  that  the 
set  of  parameters  are  restricted  to  a  small  subset,  or  equivalently,  the  equilibrium 
considered  may  not  vary  much  as  the  beliefs  about  the  underlying  uncertainty 
change.  We  will  now  present  extension  of  our  main  result  to  such  cases. 

Local  Rationalizability.  For  any  _Bi  x  ■  •  •  x  5„  C  A,  define  sets  S'f  [B;ij], 
i  e  N,k  e^,tieT^,  by  setting 

S'^[B-U]    =  U  BR,{n{-\U,a.,)), 

where  S'^~^  [B]  C  M_j  is  the  set  of  all  measurable  functions  /  :  0  x  T_j  -^  A^i 
such  that  f  {9,t^i)  G  5^"^  [B]t_i\  for  each  i.,.  Notice  that  this  is  the  same 
procedure  as  iterated  strict  dominance,  except  that  the  initial  set  is  restricted 
to  a  subset.  Unlike  iterated  strict  dominance,  these  sets  can  become  larger  as 
k  increases.  Hence  we  define  the  set  of  locally  rationalizable  strategies  by 

oo       oo 

sr[B-x]  =  {^[jsr[B-M- 

k=0  m=k 

Notice  that  the  set  S'^^lB^ti]  may  be  much  larger  than  B.  We  define  local 
version  of  W°°,  similarly,  by  setting  W^  [B;  U]  =  Bi, 

W^  [B-U]  =  {a,  e  A,\BR,  [e\a_,)  =  {aj  for  some  a.i  G  A  (w^"^  [B])}  , 

and  W°"  [B]  t,]  =  fj^o  Um=fc  ^^r  [^;  U]-  Notice  that  we  consider  all  actions  in 
our  process,  which  is  no  longer  an  elimination  process. 
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Proposition  4.  For  any  equilibrium  s*,  if  the  game  has  countable  action  spaces, 
then 

Wt  [s*  (T) ;  t,]  C  A^  [s\t,]  C  S^  [s*  (T) ;  t,]      (V^,  A:,  t,) ; 

if  the  game  is  nice,  then  with  notation  of  Proposition  2,  for  any  B  C  s*  (T), 
Sf  [B;  U]  C  Al  [s\  t,]  =  5f  [s*  {T) ;  ij       (Vz,  k,  U)  . 

The  last  statement  implies  that,  for  nice  games,  even  the  slight  changes  in 
very  higher-order  behefs  will  have  substantial  impact  on  equilibrium  behavior, 
unless  the  game  is  locally  dominance-solvable.  There  are  important  games  in 
which  a  slight  failure  of  common  knowledge  assiunption  in  very  high  orders  leads 
to  substantially  different  outcomes — as  in  Section  7. 

6.  Continuity  of  Equilibrium 

It  is  well  known  that  equilibrium  may  be  discontinuous  with  respect  to  the 
product  topology.  In  this  section  we  will  introduce  our  notion  of  continuity  with 
respect  to  higher-order  beliefs,  which  appears  much  weaker  than  continuity  with 
respect  to  the  product  topology.  We  will  show  that  even  this  weaker  continuity 
property  is  violated  in  every  equilibrium  on  a  very  large  set. 

6.1.  Equilibrium  in  pure  strategies.  We  consider  an  arbitrary  metric  d  on 
A.  A  sequence  (a'")^gf^  is  said  to  converge  to  some  a  €  ^  iff  for  each  e  >  0, 
there  exists  k  such  that  d  (a"^,  a)  <  e  for  each  m  >  k.  Given  any  subset  B  C  A, 
we  write  D  {B)  =  sup{d{a,b)  \a,b  G  B}  for  the  diameter  of  B.  As  usual,  we 
write  A'  [s\t]  =  Yl^  ^f  [s\U],  5^  [s\t]  =  fl,  S^  [t,],  etc. 

Definition  3.  An  equilibrium  s*  is  said  to  be  continuous  (with  respect  to  prod- 
uct topology)  at  t  iff  for  each  sequence  {i[m\)^      of  type  profiles 

P  [m]  -^  t''     Vfc]  ^  [s*  {i[m])  -^  s*  {t)]  . 
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An  equilibrium  5*  is  said  to  be  continuous  with  respect  to  higher-order  beliefs  at 
t  iff  for  each  e  >  0,  there  exists  k  such  that  for  each  i, 

[r  =  r    ym  <k]^d  (s*  (t)  ,  s*  {t))  <  e. 

The  latter  continuity  concept  is  uniform  continuity  with  respect  to  the  prod- 
uct topology  (on  the  type  space)  of  discrete  topologies  on  each  order  of  beUefs. 
Of  course,  continuity  with  respect  to  discrete  topology  is  much  weaker  than 
other  topologies.  The  next  lemma  presents  some  basic  facts. 

Lemma  3.  For  any  equilibrium  s*  and  for  any  t,  the  following  are  true. 

(1)  If  s*  is  continuous  at  t,  then  s*  is  continuous  with  respect  to  higher-order 
beliefs  at  t. 

(2)  s*  is  continuous  with  respect  to  higher-order  beliefs  at  t  iff  D  i^A'^  [s*  ,t\)  -^ 
0  as  k  ^'  CO. 

(3)  Ifs*  is  continuous  with  respect  to  higher-order  beliefs  at  t,  then  A^  [s*  ,t]  = 

{s*  m. 

For  nice  games,  Lemma  3.3  and  Proposition  2  imply  that  if  an  equilibrium 
s*  with  full  range  is  continuous  with  respect  to  higher-order  beliefs  at  t,  then 
5°°  [t]  =  {s*  (t)},  yielding  the  following  discontinuity  result.  (One  can  obtain 
a  similar  result  for  count  able- action  games  by  replacing  5°°  [t]  =  {s*  (t)}  with 
|M/°°[f]|  <  I.) 

Proposition  5.  For  any  nice  game,  every  equilibrium  s*  with  full  range  is  dis- 
continuous with  respect  to  the  higher-order  beliefs  (and  the  product  topology)  at 
each  type  profile  t  for  which  there  are  more  than  one  rationalizable  action  pro- 
files. In  particular,  if  a  nice  game  possesses  an  equilibrium,  s*  that  is  continuous 
with  respect  to  higher-order  beliefs  or  with  respect  to  the  product  topology,  then 
the  game  is  dominance  solvable. 
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6.2.  Mixed-strategy  equilibria  in  finite-action  games.  Endow  the  space 
of  mixed  action  profiles,  A  (A),  with  an  arbitrary  metric  d.  Extend  the  defini- 
tions of  continuity  with  respect  to  product  topology  and  higher-order  beliefs  to 
mixed-strategy  equiUbria  a*  by  replacing  s*  with  a*  in  Definition  3. 

Definition  4.  A  mixed-strategy  equilibrium  a*  is  said  to  be  weakly  continuous 
with  respect  to  higher- order  beliefs  at  t  iff  there  exists  k  such  that  for  each  i, 

Now,  continuity  in  product  topology  implies  continuity  with  respect  to  higher- 
order  beliefs.  For  finite-action  games,  the  latter  in  turn  implies  weak  continuity 
with  respect  to  higher-order  beliefs,  as  we  show  in  the  Appendix  (see  Lemma 
6).  There  we  also  show  that  strong  and  weak  continuity  of  a*  at  t  with  respect 
to  Wgher-order  beliefs  imply  that  \A°°  [a\t]\  <  1  and  A°°  [a\t]  C  supp(o-*  (t)), 
respectively.  Tliis  yields  the  following  result. 

Proposition  6.  For  any  finite-action  game  and  any  equilibrium  a*  with  full 
range,  \W°°  [t]\  <  I  whenever  (i)  a*  is  continuous  with  respect  to  higher-order 
beliefs  at  t,  or  (ii)  a*  is  weakly  continuous  with  respect  to  higher-order  beliefs 
at  t  and  a*  {t)  is  pure. 

Proof  Either  of  the  conditions  (i)  and  (ii)  implies  that  |yl°°  [a*,  t]|  <  1  (see 
Lemma  6).  Hence,  by  Proposition  3,  {W^  [t]\  <  |^°°  [a*,t]\  <  I.  D 

That  is,  for  sufficiently  rich  0,  every  equilibrium  is  discontinuous  with  respect 
to  higher-order  beliefs  (and  the  product  topology)  at  each  type  profile  for  which 
two  or  more  action  profiles  survive  iterated  elimination  of  strategies  that  can- 
not be  a  strict  best  reply.   These  type  profiles  include  the  generic  instances  of 


1,1 

-2,0 

0,-2 

0,0 
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complete-information  without  dominance  solvability.  At  each  such  type  profile, 
even  the  weakest  continmty  property  fails  if  the  equilibrium  actions  are  piu-e. 

Example  2.  Consider  the  coordinated  attack  game  with  payoff  matrix 

Attack    No  Attack 
Attack 
No  Attack 

where  there  are  two  pure  strategy  equihbria:  the  efficient  equilibrium  (Attack, 
Attack)  and  the  risk-dominant  equilibrium  (No  Attack,  No  Attack).  Since 
each  action  is  a  strict  best  reply,  no  action  is  eliminated  in  our  elimination 
process.  Therefore,  Lemma  1  and  Proposition  6  imply  that  when  we  embed  the 
coordinated-attack  game  in  a  rich  type  space  as  a  type  profile,  every  equilibrium 
must  be  discontinuous  with  respect  to  higher-order  beliefs  at  that  type  profile. 

Rubinstein's  (1989)  electronic-mail  game  presents  a  type  space  in  which  any 
equilibrimn  that  selects  the  efficient  equilibrium  in  the  coordinated-attack  game 
must  be  discontinuous  with  respect  to  higher-order  uncertainty.  In  that  example 
there  is  also  a  continuous  equilibrium,  which  selects  the  risk-dominant  action 
profile  for  each  type  profile.  Our  example  shows  that  the  latter  continuous 
equilibrium  is  an  artifact  of  the  small  type  space  utilized,  and  in  fact  in  a  rich 
type  space,  no  equilibrium  could  have  been  robust  against  higher-order  beliefs, 
and  thus  every  equilibrimn  theory  would  have  been  sensitive  to  the  assumptions 
about  higher-order  uncertainty,  strengthening  Rubinstein's  position. 

Following  Carlsson  and  Van  Damme  (1993),  global  games  literature  investi- 
gate the  equilibria  in  nearby  type  profiles  that  are  generated  by  a  model  that 
is  closed  at  the  first  order.  At  these  type  profiles,  the  game  is  dominant  solv- 
able, and  the  resulting  equilibrium  action  profile  converges  to  the  risk-dominant 
equilibrium  as  these  type  profiles  approach  the  coordinated-attack  game.  In  this 
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way,  they  select  the  risk-dominant  equihbrium.  Our  result  uncovers  a  difficulty 
in  this  methodology:  every  equilibrium  must  be  discontinuous  at  the  limit- 
ing type  profile,  and  an  equihbrium  selection  argument  based  on  continuity 
is  problematic — as  there  is  another  path  that  we  could  have  taken  the  limit  in 
which  we  would  have  selected  the  other  equilibrium.  This  is  despite  the  fact  that 
the  equilibrium  outcome  is  robust  against  higher-order  beliefs  in  these  nearby 
type  profiles  themselves  (by  Proposition  8  in  the  Appendix.) 

On  a  positive  note,  Kajii  and  Morris  (1997)  show  that  the  risk-dominant  equi- 
librirmi  is  robust  to  incomplete  information  imder  common  prior  assumption. 
That  is,  if  the  common  prior  puts  sufficiently  high  weight  on  the  original  game, 
then  the  incomplete  information  game  has  an  equilibrium  in  which  the  risk- 
dominant  equihbrium  is  played  with  high  probability  according  to  the  common 
prior.  Similar  positive  results  are  obtained  by  others,  such  as  Ui  (2001),  Morris 
and  Ui  (2003).  This  suggests  that,  when  there  is  a  common  prior,  it  may  put 
low  probability  on  the  paths  that  converge  to  other  equilibria. 

7.  Application:  Cournot  Oligopoly 

In  a  linear  Cournot  duopoly,  the  game  is  dominant-solvable,  and  hence  Propo- 
sition 8  (in  the  Appendix)  implies  that  higher-order  beliefs  have  negligible  im- 
pact on  equilibrium.  (This  has  also  been  shown  by  Weinstein  and  Yildiz  (2003) 
and  is  also  implied  by  a  result  of  Nyarko  (1996).)  On  the  other  hand,  in  a  linear 
Cournot  duopoly  with  three  or  more  firms,  any  production  level  that  is  less 
than  or  equal  to  the  monopoly  production  is  rationalizable,  and  hence  Propo- 
sition 2  implies  that  a  researcher  cannot  rule  out  any  such  output  level  for  a 
firm  no  matter  how  many  orders  of  beliefs  he  specifies.  We  will  now  show  a 
more  disturbing  fact.  Focusing  complete- information  types,  t*^^  {9),  for  fairly 
general  oligopoly  models  we  will  show  that  when  there  are  sufficiently  many 
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firms,  any  such  outcome  will  be  in  S^  [B;  t^^"^  (^)]  for  every  neighborhood  B  of 
s*  it^^  {&))■  Therefore,  by  Proposition  4,  even  a  slight  doubt  about  the  model 
in  very  high  orders  will  lead  a  researcher  to  fail  to  rule  out  any  outcome  that  is 
less  than  monopoly  outcome  as  a  firm's  equihbrium  output. 

General  Cournot  Model.  Consider  n  firms  with  identical  constant  marginal 
cost  c  >  0.  Simultaneously,  each  firm  i  produces  qi  at  cost  q^c  and  sell  its 
output  at  price  P  {Q;  6)  where  Q  =  ^^  q^  is  the  total  supply.  For  some  fixed 
6,  we  assume  that  6  is  a  closed  interval  with  0  G  0  7^  {^}.  We  also  as- 
sume that  P  (O;  ^)  >  0,  P  (•;  ^)  is  strictly  decreasing  when  it  is  is  positive,  and 
limQ^oo  P  (Q;  ^)  =  0.  Therefore,  there  exists  a  unique  Q  such  that 


p{Q-~e)=c. 


(In  order  to  have  a  nice  game,  we  can  impose  an  upper  bound  for  q,  larger 
than  Q,  without  affecting  the  equilibria.)  We  assume  that,  on  [0,  Q],  P  [■■,6)  is 
continuously  twice-differentiable  and 

P'  +  QP"  <  0. 

It  is  well  known  that,  under  the  assumptions  of  the  model,  (i)  the  profit 
function,  u  {q,  Q;6)  =  q  {P  {q  +  Q)  —  c),  is  strictly  concave  in  own  output  q;  (ii) 
the  unique  best  response  q*  [Q-i)  to  others'  aggregate  production  Q_i  is  strictly 
decreasing  on  [0,(3]  with  slope  bounded  away  from  0  (i.e.,  dq*/dQ^i  <  A  for 
some  A  <  0);  (iii)  equilibrium  outcome  at  t'-^'''  (O),  s*  (iP^  (^))'  is  unique  and 
symmetric  (Okuguchi  and  Suzumura  (1971)). 

Lemma  4.  In  the  general  Cournot  model,  for  any  equilibrium  s* ,  there  exists 
n<  00  such  that  for  anyn  >  n  and  any  B  =  \s\  (tf^  {d))  -  e,  s\  [tf^  [9))  +  e]"  C 
A  with  t  >  0,  we  have 

Sr[B;t''''{e)]  =  [0,q'']       i^ieN), 
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where  q^  is  the  monopoly  output  under  P  (•;  ^) . 

Proof.  Let  n  be  any  integer  greater  than  1  +  1/  |A|,  where  A  is  as  in  (ii).  Take 
any  n  >  n.  By  (iii),  B  =  [<?°,9*^]"  for  some  g",  if  with  q°  <  (f.  By  (ii),  for  any 
A;  >  0,  5"^'  [B;  t^'^  {9)]  =  [g^  q^y\  where 

q'  =  q*  ((n  -  1)  q'-')    and  q'^  =  q*  {{n  -  1)  q'"')  . 

Define  Q^  =  {n  -  1)  g^  Q''  =  {n  -  1)  g^  and  Q*  =  {n  -  1)  g%  so  that 

Q'  =  Q*  {Q^-')  and  Q*^  =  Q*  {Q"-^)  . 

Since  (n  —  1)  A  <  1,  the  sfope  of  Q*  is  strictly  less  than  —1.  Hence  Q''  decreases 
with  k  and  becomes  0  at  some  finite  k,  and  Q^  increases  with  k  and  takes  value 
Q*  (0)  =  (n  -  1)  g^^  at  I^  +  l.  That  is,  5'=  [S;  t^-^'  (^)]  =  [O,  g^^]"  for  each  k  >  k. 
Therefore,  5°°  [5;t^^  [O]]  =  [0,g^^]".  '  D 

Together  with  Proposition  4,  this  lemma  yields  the  following. 

Proposition  7.  In  the  general  Cournot  model,  assume  that  Q  =  \9  —  e  ,9  +  e] 
for  arbitrarily  small  e  >  0,  and  that  the  best-response  function  q*  {Q^i\9)  is 
a  continuous  and  strictly  increasing  function  of  9  at  (^Q-i,9^  where  Q-i  = 
(n  —  1)  s*  {t'^^  {9))  is  the  others'  aggregate  output  in  equilibrium.   Then, 

Ar[s\tf^{9)]  =  [0,q'']       (VzeiV), 

where  q^  is  the  monopoly  output  under  P  (•;^). 

Proof.  By  (i)  above,  we  have  a  nice  game.  By  the  hypothesis,  there  exists 
B  C  s*  [T]  as  in  Lemma  4.  Hence,  Lemma  4  and  Proposition  4  imply 

yielding  the  desired  equality.  □ 
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In  Proposition  7,  the  assumption  that  q*  (Q-z;  0)  is  responsive  to  0  guaranties 
that  5  is  a  payoff-relevant  parameter.  Our  proposition  suggests  that,  with  suf- 
ficiently many  firms,  any  equilibrium  prediction  that  is  not  implied  by  strict 
dominance  will  be  invalid  whenever  we  slightly  deviate  from  the  idealized  com- 
plete information  model.  To  see  this,  consider  the  confident  researcher  and  his 
slightly  skeptical  friend  in  the  Introduction.  The  former  is  confident  that  it 
is  common  knowledge  that  9  =  6,  while  the  latter  is  only  willing  to  concede 
that  it  is  common  knowledge  that  |^  —  ^|  <  c  and  agrees  with  the  A-th-order 
mutual  knowledge  of  9  =  9.  He  is  an  arbitrarily  generous  skeptic;  he  is  willing 
to  concede  the  above  for  arbitrarily  small  c  >  0  and  arbitrarily  large  finite  k. 
Our  proposition  states  that  the  skeptic  nonetheless  cannot  rule  out  any  output 
level  that  is  not  strictly  dominated. 

8.  Conclusion 

It  is  a  common  practice  in  economics  to  close  the  model  after  only  specifying 
the  first  or  second  order  beliefs,  using  a  (mostly  implicit)  common  knowledge 
assumption.  In  this  paper,  we  have  investigated  the  role  of  this  assmiaption  in 
predictions  according  to  an  arbitrary  fixed  equilibrium.  Finding  strong  lower 
and  upper  bounds  for  the  variations  with  respect  to  this  assumption,  we  have 
shown  that  it  is  this  casually  made  common  knowledge  assumption  that  drives 
any  prediction  that  we  could  not  have  made  aheady  by  iteratively  eliminating 
strategies  that  can  never  be  strict  best  reply.  In  games  like  Cournot  oligopoly, 
this  implies  that  no  interesting  conclusions  could  have  been  reached  without 
making  a  precise  common  knowledge  assiimption.  In  some  other  games,  such 
as  sequential  games,  our  lower  bounds  are  weak,  and  one  may  plausibly  make 
sharp  predictions  using  much  weaker  assumptions.  Therefore,  it  is  essential  for 
assuring  the  reliability  of  theories  to  pay  special  care  to  closing  assumption  and 
justify  it  at  least  as  much  as  the  other  assumptions. 
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When  there  are  two  or  more  actions  that  survive  our  ehmination  process, 
there  is  an  inherent  unpredictability  wliich  cannot  be  avoided  without  mal<;ing 
an  assumption  on  infinitely  many  orders  of  beliefs,  as  all  of  these  actions  are 
played  with  probability  1  by  some  types  whose  finite-order  beliefs  agree  for 
arbitrarily  high  orders.  In  that  case,  equilibrium  is  necessarily  discontinuous 
with  respect  to  higher-order  beliefs  and  in  product  topology.  Moreover,  when 
there  are  no  ties,  there  is  a  one-to-one  relationship  between  this  sensitivity  to 
higher-order  beliefs  and  sensitivity  to  higher-order  assumptions  about  players' 
rationality.  It  then  becomes  very  difficult  in  analyzing  these  situations  to  justify 
the  common  knowledge  of  rationahty  as  a  good  approximating  assumption. 

Appendix  A.  Proofs  and  further  results 

Proof  of  Lemma  1.  Take  any  i  and  any  Oj.  Take  any  7  6  A(T_i)  with  countable 
support,  and  let  /i  =  7  o  (slj)  G  A  {A-i).  Let  v  be  as  in  Assumption  1.  Define  t, 
as  the  type  such  that  kj^  =  vx^.  Notice  that  tt  (-1^;,  s*_^  =  Kf^o/3~-^  =  (;/  x  7)0/3"^  = 
(7  o  (•slj)~  j  =  i^x/i.  Hence,  s*  [U)  =  BR^  (tt  [■\U,  s*_^))  =  BR,  {v  x  n)  =  ai.     D 


i/x 


Proposition    8.    For  any  equilibrium  s* ,    any  player  i,    and  any  ti   and  k   <    00, 

Proof.  For  k  =  0,  the  proposition  is  true  by  definition.    Assume  tiiat  it  is  true  for 
some  k  -  I  >  0,  i.e.,  for  any  i,  and  for  for  each  i_,;,  A'^^  [s*,t_j]  C  5^7^  [^-^1-  Now, 
T-iC  LxH  where  L  =  (u^Z^  A  (X,_i))"~    and  H  =  (jj'^,^  A  (X;_i))"      are  the 
spaces  of  lower  and  higher-order  beliefs  with  generic  members  I  and  h,  respectively. 
Now  take  any  U  with  ff^  =  t™^  for  all  m  <  k.  Clearly, 

(A.l)  margexL^t^  =  margexi'^t,- 


^T_i  ^  L  X  H  because  of  the  coherency  requirement,  which  has  no  impact  on  the  rest  of 
the  proof,  (kj^  and  Kj    put  probability  1  on  the  subset  T_i.) 
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For  each  (0,/)  G  OxL  with  margexL^^t"  (i?,/)  =  k,;({(6I,0}  x  H)  >  0,  let  P  (•|6',  Z,  si-) 
be  the  the  probabihty  distribution  on  A-i  induced  by  the  behef  tj  and  s*_^  conditional 
on  {9,1),  i.e., 

(A.2)  P  (a_,|0, 1,  sU)  =  ^u  {{{0. 1,  h)  \sU  {I,  h)  =  a_,})  /k^^  {{{9, 1)}  x  H) 

at  each  a_i.  Since  there  are  only  countably  many  (9,1)  with  margexL^j-  (^,0  >  Oi 
there  exists  a-i  6  A  (M_,)  such  that  u-i  ({s_i|s_j  {9, 1,  h)  =  a_j})  =  P  (a_i|0,  Z,  s*_^ 
for  each  such  {9,1),  and  a^i  ({s_j|s_i  {9,t^j)  =  s_i  (0,  t_j)})  =  1  otherwise  for  some 
fixed  S-i  G  5'_~~  .  Note  that  according  to  a-i,  at  each  {9,1)  in  the  support  and  for 
each  a-i,  the  probability  that  a_i  is  played  is  always  P  (a_i|6', /,  slj.  By  induction 
hypothesis,  we  then  have 


(A.3)  a.,(^[s-,\s^,{9,l,h)&S'lt[{lM]])=^- 

Moreover,  for  each  {9,  a_j)  with  t\  (9)  =  t|  (9)  >  0, 
7T{{9,a-,)\U,a_^)     =      fl^g^-g^P{a-,\9,l,s*_,)dKt,{0,l,h) 

=      /  l{e=e}-P  {a-^\9, 1,  s*_^)  Kt.  ({(61,  0}  x  H)  dmargQxiKt,  {9, 1) 

=         l^g^^Kt^{{{9,l,h)\s*_i{l,h)  =  a^^})dmavgQ^Ld%{9,l) 
=     TT  ((0,a_O  |ii,slj  , 

where  l/g-gi  is  the  indicator  function  for  {0  =  ^};  the  first  equality  is  obtained 
by  integrating  over  a-i  appropriately;  the  second  equality  is  due  to  the  fact  that 
P  (a_j|0, 1,  slj)  does  not  depend  on  h,  and  the  third  equality  is  due  to  (A.l)  and  (A.2). 
When  t]  {9)  =  ij  {9)  =  0,  we  trivially  have  n  {{9,  a-i)  \ti,  a-^)  =  n  {{0,  a-^)  \U,  slj  = 
0.  Hence, 

s*  {U)  G  BFU  [n  {-It,,  s*_,))  =  BR,  {n  {-lU,  a-,))  C  S^  [U] , 

where  the  last  inclusion  is  by  (A.3)  and  definition  of  5^^  [ti\.  D 

Proof  of  Lemma  2.  It  follows  from  the  following  lemma.  D 

Lemma  5.  For  any  nice  game  and  for  any  i,  ti,  k,  the  following  are  true. 
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(1)  Sf  [ti]  =  [a^,a^]  for  some  af,a^  S  Ai,  which  depend  on  U. 

(2)  For  each  a^  G  5f  [ti],  there  exists  s_,  G  S.~^  such  that 

BR,{n{-\t^,s^i))  =  {a\]. 

Proof.  We  will  use  induction  on  k.  For  /c  =  0,  part  1  is  true  by  definition.  Assume 
that  part  1  is  true  for  some  A;  —  1,  i.e.,  5-""^  [tj\  is  a  closed  interval  in  Aj  =  [0, 1] 
for  each  j.  This  implies  that  Sj^  is  a  closed,  convex  metric  space  (with  product 
topology).'  Moreover,  by  the  Maximum  Theorem,  BRi  {n  {-jti,  s_j))  is  an  upper-semi- 
continuous  function  of  s-i.  But  by  the  strict  concavity  assumption,  BRi  (tt  (-1^^,  s-i)) 
is  singleton,  and  hence  the  function  /3j  (s^i)  that  maps  each  s_j  G  S_~^  to  the  unique 
member  of  BRi{iT  {■\ti,s-^))  is  continuous.  Since  S_~  is  compact  and  convex,  this 
implies  that  P^  i  Sj^  ;ti]  is  compact  and  connected,  and  hence  it  is  convex  as  it  is 
unidimensional.  That  is,  /3j  f  S'^~^;ti  j  =  [a*^,  a'^]  for  some  a*^,  df  G  Ai.  We  claim  that 
Pi  [S_~  ',ti]  —  5f  [ti\.  This  readily  proves  part  1.  Part  2  follows  from  the  definition 

Towards  proving  our  claim,  for  each  {9,t-i)  G  supp^t;  and  for  each  s_i  G  S_~  , 
define  function  Ui{-\9,t^i,s-i)  by  setting  Ui{ai\9,t-i,S-i)  =  Ui{9,ai,  s-i{6,t-i))  at 
each  Qi.   Clearly,  Ui  is  strictly  concave,  and  for  each  cr_i  G  A  iSj^   ),  the  expected 


payoff  of  type  ti  is 

(A.4)  /  Ui  {ai\9,  t_,,  s-i)  dKt^  (9,  t-^)  da-^  {s-^) . 

Now,  take  any  a^  >  df.  Then,  for  each  {9,t-i,s-i),  by  definition  of  aj^  and  strict 
concavity  of  Ui{-\9,t-i,s-i),  we  have  U^{a^\9,t-i,s-^)  <  J7,  [d'^\9,t-i,S-i).  It  then 
follows  from  (A.4)  that  d^  yields  higher  expected  payoff  than  at  for  each  (T_j  G 
A  (  S'^jM,  and  thus  a^  0  5;  [ti].  Similarly,  a^  0  Si  [ti]  for  each  aj  <  af .  D 


^Proof:  Firstly,  Yl(e  t  i)  ^j~^  i^A  ^^  ^  compact  space  by  Tychonoff's  theorem.  But  the 
space  of  all  measurable  functions  /  :  0  x  T_i  -^  R'^\^'^  is  closed.  Hence,  the  intersection  of 
these  two  spaces,  namely  5^7^'  i^  compact.  Convexity  of  5^7^  follows  from  the  facts  that 
measurabihty  is  preserved  under  point-wise  multiplication  and  addition  and  that  the  range  is 
convex. 
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Proof  of  Lemma  3.  Part  2  follows  from  the  definitions,  and  Part  3  follows  from  Part 
2  and  the  fact  that  D  {A°°  [s*,i])  <  D  [A''  [s*,t])  for  each  k.  To  prove  Part  1,  take 
any  e  >  0  and  any  sequence  6;^  >  0  that  converges  to  0.  For  each  fc,  there  exists  t  [k] 
such  that  i'"  [fc]  =  f^  for  each  m  <  k  and  d  [s*  {i[k\)  ,  s*  [t))  >  D  {A''  [s*,t])  /2  -  e^ 
so  that 

(A.5)  0<D(^A''[s\t]^<2d{s*{i[k]),s*it))  +  2ek.       ■ 

But,  by  definition,  for  each  m  and  each  k  >  m,  i^  [k]  =  i'",  and  hence  i™  [k]  — »  i™  as 
k  — >  oo.  Hence,  if  s*  is  continuous  at  t,  then  as  fc  — >•  oo,  s*  (i  [/c])  — +  s*  (f),  and  thus 
the  right  hand  side  of  (A.5)  converges  to  0.  That  is,  D  (^A''  [s*,  t])  — >  0,  showing  by 
part  2  that  s*  is  continuous  with  respect  to  higher-order  beliefs  at  t.  D 

Lemma  6.  For  any  finite-action  game,  the  following  propositions  are  ordered  with 
logical  implication  in  the  following  decreasing  order. 

(1)  a*  is  continuous  with  respect  to  product  topology  at  t. 

(2)  a*  is  continuous  with  respect  to  higher-order  beliefs  at  t. 

(3)  a*  is  weakly  continuous  with  respect  to  higher-order  beliefs  at  t. 

(4)  A'^[a\t]  C  supp{a*{t)). 

Moreover,  (2)  implies  that  \A°°  [a* ,t]\  <  1. 

Proof.  Since  mixed  strategies  can  be  considered  as  pure  strategies  with  values  in 
A{Ai),  by  Lemma  3.1,  (1)  imphes  (2).  To  show  that  (2)  implies  (3),  for  each  B  C  A, 
write  T,B  =  {a  G  A  (yl)  |supp  (a)  C  B},  which  is  a  compact  set.  Then,  for  each 
disjoint  B  and  C,  ds^c  =  min  {(i(aB,Q;c)  \o^b  £  "^BjO^C  G  E^}  >  0.  Write  rfmin  for 
the  minimum  of  ds^c  among  all  disjoint  B  and  C.  Clearly,  if  d{a,a')  <  dmm,  then 
the  supports  of  a  and  a'  have  non-empty  intersection.  But  (2)  implies  that  there 
exists  k  such  that  whenever  i"^  =  t'"  for  each  m  <  k,  d[a*  (t)  ,a*  (t))  <  c^min/2, 
whence  supp(a*  (f))  nsupp(a*  (i))  7^  0 — hence  (3).  (3)  imphes  (4)  because  for  each 
a  E  A'^  [c*!^]  and  each  k,  there  exists  i  such  that  f'"  =  i'"  for  each  m  <  k  and 
supp(a*  (t))   —  {a}.    The  laist  statement  in  the  lemma  also  follows  from  the  latter 
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observation  because  a*  {t)  cannot  be  arbitrarily  close  to  two  distinct  pure  action 
profiles.  D 
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